Decoding Generalized Concatenated Codes Using 
Interleaved Reed-Solomon Codes 



Christian Senger, Vladimir Sidorenko, Martin Bossert Victor Zyablov 

Inst, of Telecommunications and Applied Information Theory Inst, for Information Transmission Problems 

Ulm University, Ulm, Germany Russian Academy of Sciences, Moscow, Russia 

{christian. senger | vladimir.sidorenko | martin.bossert}@uni-ulm.de zyablov@iitp.ru 



Abstract — Generalized Concatenated codes are a code con- 
struction consisting of a number of outer codes wliose code 
symbols are protected by an inner code. As outer codes, we 
assume the most frequently used Reed-Solomon codes; as inner 
code, we assume some linear block code which can be decoded up 
to half its minimum distance. Decoding up to half the minimum 
distance of Generalized Concatenated codes is classically achieved 
by the Blokh-Zyablov-Dumer algorithm, which iteratively de- 
codes by first using the inner decoder to get an estimate of the 
outer code words and then using an outer error/erasure decoder 
with a varying number of erasures determined by a set of pre- 
calculated thresholds. In this paper, a modified version of the 
Blokh-Zyablov-Dumer algorithm is proposed, which exploits the 
fact that a number of outer Reed-Solomon codes with average 
minimum distance d can be grouped into one single Interleaved 
Reed-Solomon code which can be decoded beyond d/2. This 
allows to skip a number of decoding iterations on the one 
hand and to reduce the complexity of each decoding iteration 
significantly - while maintaining the decoding performance - on 
the other. 

I. Introduction 

In 1966, Forney introduced the concept of concatenated 
codes [1]. It was generalized in 1976 by Blokh and Zyablov to 
Generalized Concatenated (GC) codes [2]. The GC approach 
allows to design powerful codes with large block lengths 
using short, and thus easily decodable, component codes. 
The designed distance and the performance of GC codes can 
■ be easily estimated theoretically. This allows to design GC 
' codes for applications like e.g. optical lines, where block 
error rates in the order of 10~^^ are required, a region, 
where simulations are not feasible. GC codes can be decoded 
up to half their minimum distance using a sufficiently large 
number of decoding attempts for each outer code in the Blokh- 
Zyablov-Dumer algorithm (BZDA) [3], see also Dumer [4], 
[5]. We should also mention papers by Sorger [6], and Kotter 
[7] who suggested interesting modifications of a BMD decoder 
in such a way that multi-attempt decoding of the outer code 
can be made "in one step". Nielsen suggested in [8] to use the 
Guruswami-Sudan list decoding algorithm [9] for decoding 
the outer codes and has shown that in this case also one 
decoding attempt is sufficient to allow decoding up to half the 
minimum distance of the GC code. In this paper, we employ 
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another idea, which allows to decrease the number of outer 
decodings, but also to skip many decodings of the inner code. 
This idea is based on Interleaved Reed-Solomon (IRS) codes 
[10]. Other aspects of using IRS codes in concatenated codes 
were considered in [11], [12]. 

The rest of our paper is organized as follows: In Section 
II we explain GC codes as well as the required notations 
and assumptions. Section III explains IRS codes and where 
they appear within GC codes. Section IV gives an overview 
of the BZDA as introduced in [3]. A generalization of this 
is given in Section V, leading to a new algorithm which 
maintains the error-correcting performance of GC codes while 
reducing the number of outer decodings and skipping many 
inner decodings. In Section VI we illustrate our results by 
means of some examples. 

II. Generalized Concatenated Codes and their 
Decoding 

Encoding of a GC code C{n, k, d) of order £ is as follows, 
where we restrict ourselves to outer RS codes C°(n°, fc°, d°), 
I ~ 0, . . . over the binary extension field F2™ and an inner 
binary block code C'(n', k\d^) with dimension fc' = £m. 

The first step is outer encoding. For this we take £ code- 
words c° of the outer codes C° and put them as rows into an 
£ X n° matrix 




over F2™. The second step is inner encoding, where the 
binary counterparts of the columns j — 0, . . . ,n° — 1 of A 
are encoded by the inner code to obtain code word columns 
c''"^ S C\ The result of this procedure is a binary 71' x n° 

i T i T 

matrix C := (cj , . . . , c^o_i), which in turn is a code word 
of the GC code C. 

The inner code C has the following nested structure: The 
code words are obtained by encoding an arbitrary binary 
information vector {uq, . . . , If we fix / S {0, ... , £—1} 

groups of TO information bits starting from uq and encode, we 
obtain a subcode C; (mq, . . . , U(;-i)m-i) ^ C' with distance 
d\. Note that dj, < ■ • • < d^g_i due to the special choice 
of encoders for the subcodes C;. Obviously, Cq = C\ The 



minimum distance of the GC code C is then lower bounded 
by its designed distance 



d := mmld^d^Q, . . . , d1_id\_i}. 



(1) 



The channel adds a binary error matrix E of weight e to the 
transmitted concatenated code matrix C, resulting in a received 
matrix R := {tq^, . . . , r^r_i) = C + £^ at the receiver. 

As output of GC decoding with the BZDA we want to obtain 
a matrix 



A := {aij) 



j)i=0,. 



.,e-i,j=o,.. 



over F2™, which is an estimate of the matrix A. Decoding 
consists of £ iterations, where iteration / = 0, 1 is as 

follows: 

(i) Decoding of all columns r^'^, j = 0, . . . , n° — 1, of the 
received matrix R by BMD decoders for the nested sub- 
codes C; (aoj, . . . , ai-ij), correcting up to [{d\ — 1)/2J 
errors and altogether yielding a new estimate c° for the 
l-th row of A. 

(ii) Execution of zi attempts of decoding with C;° and 
a different number of erased symbols in each attempt, 
which yields a candidate list of at most size z;. Finally, 
the "best" candidate from this list has to be selected 
using some criterion and inserted into A. 

Note that because of this recurrent structure it is suf- 
ficient to consider the BZDA only for ordinary concate- 
nated codes, as decoding of GC codes simply means re- 
peated application of this special case for the sequence 
Cq, . . . , C;(aoj, . . . , ai-ij), . . . , Q_i(ao,j, . . - , a^-2,j) of the 
nested inner subcodes, j = 0, . . . , n° — 1, and the correspond- 
ing outer codes [4], [5]. The details of the BZDA for ordinary 
concatenated codes are described in Section IV. In [3] it is 
shown thsit if y I G {0, ...,£- 1} : zi = d\/2 for even d\ 
the BZDA can decode up to l{d°d\ — 1)/2J errors in the Z-th 
iteration and thus by (1) also up to [{d—l)/2\ errors in a GC 
code word. 

III. Interleaved Reed-Solomon Codes 

Observe that the matrix A is just an interleaved set of £ 
different RS codes, hence an IRS code. For IRS codes an 
efficient decoding algorithm was suggested in [12], which 
has only £ times the complexity of the Berlekamp-Massey 
algorithm for decoding one single RS code. The algorithm 
allows to correct at most r(£) := [{d° — 1)£/ {£+l)\ erroneous 
columns of A, where d° := ^/£Yl\Z^'^'i average 
minimum distance of the interleaved set of RS codes and 



> r{£), l = Q,...,£-l. 



(2) 



The IRS decoding algorithm from [12] yields a decoding 
failure with some probability. However, this probabihty can 
be made small and is neglected here. 

If the complete matrix A does not satisfy (2), we can split it 
into a number of submatrices with the same length as A, which 



all fulfill (2) and thus can be decoded by the IRS decoding 
algorithm from [12]. Assume that 



Ay — 



V 



\ 



J 



is such a submatrix of A and forms an IRS code with average 
minimum distance d°, that satisfies both constraint (2) and 
d°dl£/{£ + 1) > d. The main idea of applying the IRS 
decoding algorithm from [12] to GC codes is as follows: We 
can replace £ iterations v, ...,v + £ — 1 of the BZDA by the 
following single iteration: 

i T 

(i) Decoding of all columns rj , j = 0, . . . , n° — 1, of the 
received matrix R by BMD decoders for the subcodes 
Cy{ao,j, ■ ■ ■ jflu-ij), correcting up to [(d^ — 1)/2J errors 
and yielding an estimate Ay for the submatrix Ay. 

(ii) Execution of Zy attempts of IRS decoding Ay with a 
different number of erased columns in each attempt, 
which yields a candidate list of at most size Zy. Finally, 
the "best" candidate Ay from this list has to be selected 
using some criterion and inserted into A. 

As a result of this method, we skipped n°{£ — 1) inner 
decodings and we will show that the number of required 
decoding attempts for the outer code to guarantee decoding 
up to [{d°dy — 1)/2J channel errors is much smaller than 
in the original BZDA, which in practice means Zy e {2,3}. 
Eventually, our modified algorithm corrects up to half the 
minimum distance of the GC code. 

IV. BZDA WITH Outer BMD Decoding 

In this section, we consider decoding of a simple con- 
catenated code C, which consists of the outer RS code C° 
and the inner binary code C\ This corresponds to the l-th 
iteration of the refined BZDA from [4] for a GC code where 
it holds w.l.o.g C° = Cf, C = Cliao,j,...,ai-ij) and 
Vi G {0, .. - l},ii,i2 e {0, .. .,n° - 1} : aij^ = a^,^. 

First (step (i) of the BZDA), we decode the columns r^' of 
the received matrix i? by a BMD decoder for C\ correcting up 
to [{d^ — 1)/2J errors and yielding code word estimates c^'^ or 
decoding failures. Decoding of the outer code C° is performed 
with respect to the ordered set of thresholds {T{ ',. . . ,Ti '} 
with < T^''^ < ■ ■ ■ < T^"'' < (rf - l)/2. For each decoding 
attempt k e {l,...,^} the decoding results of the inner 
decoder depend on the threshold Tk in the following manner: 
The symbols f° (k) £ U{X} delivered to the outer decoder 
at position j are 



f°(fc) := 



enc-/(c;.), dH(r},c}) <rfe, 



dH{r),^j)>Tk, (3) 
failure of the iimer decoder, 



where is the received word in the j-th column, c^' is 
the result of inner decoding, enc^i^( ) maps code words of 
C to the corresponding g-ary information symbols, and X 
is the symbol for an erasure. As result from outer decoding 
f°(fc) := (fg(fc), . . . , f°o_i{k)) we obtain the outer code word 



estimate c°{k) = (c3(fc), . . . , c°o_i(fc)). From (3) follows 
that thresholds with equal integers parts yield equal decoding 
attempts, so the number of z* actual attempts may be smaller 
than the number z of thresholds, i.e. z* < z. 

The numbers of decoding errors and erasures occurring at 
decoding r°(fc) are denoted by e{k) and T(fc), respectively. 
The outer RS code C° can successfully decode as long as 
2e(A;) + r(/c) < d°, since we assume outer BMD decoding in 
this section. For a fixed number z of thresholds, the following 
theorem fixes the optimum values of the thresholds such that 
the decoding bound of the BZDA is maximized. 

Theorem 1 (Blokh, Zyablov [3]) For a concatenated code 
with outer BMD-decoded RS code and inner BMD-decoded 



(^) 



code C^(n\k\d^), the set of thresholds {T^ 
which maximizes the decoding bound is determined by 



1 



22+1 



1, 



(4) 



If the thresholds are chosen according to (4), the decoding 
bound is given by the following theorem in a sense that the 
transmitted code word is among the elements of the result Ust 
£:={c°(l),...,c°(z*)}. 

Theorem 2 (Blokh, Zyablov [3]) For a concatenated code 
with outer BMD-decoded RS code C°{n°,k°,d°) and inner 
BMD-decoded code C'(n', k\ d^), the decoding bound is 



e < d°{\T^/^\+l) = d°z 



1 



2z + l 



(5) 



In Figure 1, the decoding bound (5) is plotted with circles 
versus the number of thresholds z for an example with d° = 
33, d' = 20. It can clearly be seen that the bound reaches 
d°d^ /2, i.e. half the minimum distance of the concatenated 
code with increasing number of thresholds. The bound ob- 
viously only depends on the greatest threshold Tz . If we 
hypothesize that the number of thresholds tends to infinity, 
we can see that for the greatest threshold 



J.(2) 



1 



=: T^°°\ 



But as T(^^ = (d' — l)/2, we know that the greatest possible 
integer threshold [Tio°°'j is ^72-1 if rf' is even, and (d'-l)/2 
if d' is odd. This allows to state the following theorem, which 
confirms our observation from Figure 1. 

Theorem 3 If the number of thresholds z tends to infinity, 
the decoding bound of the BZDA for a concatenated code C 
with outer BMD-decoded RS code C°{n°,k°,d°) and inner 
BMD-decoded code C'(n', fc',d') is 

e < — . (6) 

Proof: The decoding bound (5) is non-decreasing in z, 
hence it assumes its maximum at 2 — > oo. Consider two cases: 



(i) d' is even, thus the greatest possible integer threshold is 
dV2 - 1 and e < d°(dV2 - 1 + 1) = d°dV2. 

(ii) d' is odd, hence the greatest possible integer threshold is 
(d' - 1)/2 and e < d° ((d' - l)/2 + 1) = d°d72 + d°/2. 

■ 

In the following, we restrict ourselves to binary error 
matrices E meeting (6). 

To obtain decoding bound (6), the greatest possible integer 
threshold needs to be among the threshold set. For even d' 
this greatest integer threshold is Teven := L^oo°^J — ^ 1'^ ~ !> 
which is strictly smaller than the limit Tt^^ . By the following 
lemma it can be reached already for a rather small value of z. 



Lemma 1 For a concatenated code with inner BMD-decoded 

code C^{n^ ,k^ ,d^) and outer BMD-decoded RS code C° the 
greatest possible integer threshold Tgven is reached if z > 
z := d'/2. 

Proof Solve ri'^ > Teven for z. m 
We can thus obtain (6) with only dY2 thresholds according 
to (4) if d' is even. 

If however d' is odd, the greatest possible integer threshold 



is Todd := Tc 



(oo) 



(d' - 1) /2, i.e. the limit T^'^ itself. It can 



obviously only be reached for an infinte number of thresholds. 

But the number of integers below Todd is (d' — l)/2, hence 
the number of actual decoding attempts is upper bounded by 
(d' — l)/2. It follows that even though in the d' odd case the 
number of required thresholds is infinite, only z* = (d' — 1)/2 
outer decoding attempts are sufficient to achieve decoding 
bound (6). 

Up to now, we only know that the transmitted outer code 
word c° is somewhere within the result list £ of the BZDA 
if (6) is fulfilled. The following lemma provides a means of 
exactly determining its position among the elements of C. 

Lemma 2 (Blokh, Zyablov [3]) Let t{k) := E"Io^*j(^) 
with 



A 



t,{k) 



ifc°ik)=enc-\c)) 



Y , failure of the inner decoder, 



and Aj := dH(i"j , c^ ). Assume e < d°d^/2 and that T}.^ is a 
threshold with c°{ko) = c°. Then 



t{ko) < 



d°d' 



(7) 



and 



VfcG{l,...,|£|}, k^ko:t{k)>^. 



The lemma guarantees that only the transmitted outer code 
word c° = c°(A;o) fulfills (7), i.e. that no further decoding 
attempts have to be executed as soon as (7) is fulfilled for the 
smallest threshold index k € {1, . . . , z}. Then, we set ko := k 
and choose c° = c°(fco). 



V. BZDA WITH Outer IRS Codes, i.e. Outer BD 

Decoding 

Now we consider the case where C° is an IRS code, 
i.e. a row-wise arrangement of ^ > 2 RS codes of equal 
length but potentially different dimensions, which are decoded 
collaboratively as described in Section III. This allows C° to 
correct a larger number of errors leading to a decoding success 
whilst Ac (fc) + r(fc) < rf° - 1, where 1 < \ := <2. 
This means Bounded Distance (BD) decoding. Our aim now 
is to derive formulae corresponding to (4) and (5) for this 
specific case. In doing so, we generalize the approach for outer 
BMD decoding from |3|. The procedure is as follows: Let Cfaii 
be the smallest number of channel errors for a given set of 
thresholds {T'f\ ■ ■ ■ ,1^^'}, such that all decoding attempts 
fc € {1, . . . , z} fail, i.e. such that 

Vfc e {1,...,^} : A£(A;) +T(fc) >d° -1. (8) 

We determine 

efaii := min {e} 

under the condition that (8) is fulfilled. Then, we find the 
set {Tl ' , . . . , Tr ^ } of thresholds which maximizes this mini- 
mum, i.e. the set of thresholds, which maximizes the decoding 
bound. This set is determined by the expression 

{Ti(^\...,Ti^)}:= argmax {cfaii}. 

The detailed derivation is too involved to be presented here, 
so we confine ourselves to the results in form of the following 
theorems. 

Theorem 4 For a concatenated code C with outer collabo- 
ratively decoded IRS code C° consisting of I RS codes and 
inner BMD-decoded code CHn\k\d^), the set of thresholds 
{T|"^...,^r'} which maximizes the decoding bound is 
defined by 



with 



^ d'-l + A(A-l)^ 
:= — ^ rv, , a :- 



2-\{\-lY ' 2-A(A-l)^' 

k G {1, . . . , z}, where z is the number of thresholds and 1 < 
X={i+l)/l<2. 

Theorem 5 For a concatenated code C with outer collabo- 
ratively decoded IRS code C°{n°, k°,d°) consisting of I RS 
codes and z thresholds chosen as in (9), the decoding bound 
is given by 

e<rf°(Lri^)j + i). (10) 

By Theorem 5 the decoding bound only depends on thresh- 
old Tz , the greatest one among the ordered threshold set 



(^) 



(z 

Tz \. Hence to maximize the decoding bound 
(10) we have to maximize Tz . Since the threshold location 
function (9) is non-decreasing, the greatest threshold occurs for 



2 — » 00, and is Too ^ := id} — l)/2. The following theorem 
states the decoding bound for this greatest possible threshold. 

Theorem 6 Let C be a concatenated code with inner BMD- 
decoded code C^{'n},k^,d^) and outer IRS code C° with (. > 
2. If the maximum possible integer threshold is among the 
threshold set, the decoding bound is given by 



d°d' 



e < 



Proof: Inserting the the integer parts Teven := L^(>d°^J = 
d'/2 - 1 and Todd := T^^ = (rf - l)/2, respectively, of 
the greatest possible thresholds into bound (10) proves the 
statement. ■ 
For even d\ the greatest possible integer threshold Teven 
already is reached considering a finite number of thresholds, 
i.e. if z>z:= mm{z} s.t [T^"'^ } = Teven = d'/2 - 1. Thus 
for even the finite threshold set 



7- — (rpis) 'r(z)\ 
■'even ■ — \-f i j • • • j z J 



(11) 



is sufficient to obtain the maximum of (10). 

If on the other hand d' is odd, the greatest possible integer 
threshold Todd is T^^ itself, hence the number of required 
thresholds in fact is infinite. But since we know that decod- 
ing attempts corresponding to thresholds with equal integer 
parts coincide, we can skip all thresholds within the interval 



1,T^^) by the following lemma. 



Lemma 3 For a concatenated code with inner BMD-decoded 
code C'(n', fc', rf) and and outer IRS code C° with I collab- 



(00) 



oratively decoded RS codes T 
reached if k > k :— [log^;((f + 1) 



1 = (rf - l)/2 - 1 is 



Proof: If z ^ oc, then the threshold location function 
:= (rf - l)/2 - (rf + 1)(A - l f/2. But 



(9) (9) becomes Tf 

-,(00) 



Tr> > (rf' - l)/2 - 1 ^ fc > log, {{d' + l)/2). 

By Lemma 3 we know that all thresholds T^°°^ in the 
range k < k < 00 have equal integer parts and therefore 
can be omitted. Thus, instead of the infinite threshold set 

{t( ■ 



(00) 



. , T^^ } it is equivalent to consider the finite set 



odd • = 



rT'(°°) 



,r(°^)}u{T^-)} 



(12) 



with only k-{-l= [log, ((rf -h l)/2)] -M elements. 

We know that if we utilize the sets T^ven and T^dd of 
thresholds according to (9) for even and odd inner mini- 
mum distance d\ respectively, we can decode up to half 
the minimum distance of the concatenated code C. However, 
the integer parts not of all the thresholds among the sets 
are necessarily pairwise different. Since decoding attempts in 
respect to thresholds with equal integer parts coincide, the 
number z* of actual decoding attempts which need to be 
executed to decode up to half the minimum distance of C may 



be smaller than the number of thresholds. We can calculate it 
exphcitly by 




=i{LTrj}i<^, 

=i{L7^^^J}u{Lr(r=^J}| 



< fc + 1. 



even 
odd. 
(13) 



VI. Concluding Examples 



Our results are subsumed using the following examples. 
We assume a concatenated code C consisting of an inner 
code C'(n', fc', c?') and an outer code C° {n° , k° , d°) con- 
sisting of £ rows containing code words of the RS code 
7e5(2^ 255,223,33). 

For even inner minimum distance = 20 the decoding 
bounds (5) for independent outer decoding and (10) for 
collaborative outer decoding, respectively, depending on the 
number z of thresholds are shown in Figure 1. According to 
Lemma 1, for independent outer decoding z_~ 10 thresholds 
are sufficient to decode up to half the minimum distance of 
C. If collaborative decoding of £ = 2 outer RS codes is 
applied, we can calculate the number of required thresholds 
by z = min{z} s.t [tJ^'J = 9 and get z_ — 3. Both values 
are confirmed by the bounds in Figure 1 . 
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Fig. L Number of thresholds versus decoding bounds (5) and (10). The outer 
code C° consists of £ = 2 RS codes and C has (even) minimum distance 
= 20. 



If the RS codes are outer codes C°, . . . ,C°^i_-^ of a GC 
code as described in Section II, which fulfill (2), the saving in 
terms of operations is even greater. Besides the 7 saved outer 
decoding attempts, the number of inner decodings can then be 
cut down by n°{e - 1) = 255. 

Note that decoding one IRS code with i interleaved RS 
codes with the algorithm from [12] has the same complexity as 
decoding the £ RS codes independently. Thus, our comparison 
of both constructions is fair in terms of complexity. 

After establishing the result list C, Lemma 2 can be applied 
to select the transmitted code word among its |£| < z* 
elements. 



Figure 2 shows the number of actual decoding attempts z* 
as well as the number z_ of thresholds for some reasonable odd 
inner minimum distances d\ Collaborative decoding of ^ = 2 
and £ ^ 8 outer RS codes is considered. For independent outer 
decoding as described in Section IV, z* grows linearly with 
d\ It diminishes to at most z* — 6 already for an outer IRS 
code with £ = 2. For an outer IRS code with ^ = 8 already 
z* = 2 decoding attempts are sufficient to decode up to half 
the minimum distance of C over the full range of all considered 
odd inner minimum distances d' e [3, 100]. 
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Fig. 2. Required numbers of thresholds and actual decoding attempts to 
allow decoding up to half the minimum distance of a concatenated code C 
with parameters as described above. For clarity, only odd d' are plotted. 
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